Immersive data visualization

ABSTRACT

A system and method for visualizing multiple datasets in a virtual 3-dimensional interactive environment. Multiple datasets may be related and virtually cast as 3-dimensional type structures. User interfaces, such as game controllers or headsets, may be used to present the dataset from differing perspectives including the appearance of moving through the data. Certain embodiments provide for mirror image views that allow for presentation of higher order datasets. Other embodiments provide for animation or motion indicia to show how the data is changing and the results on the display. The datasets may represent physical areas or virtual areas as well as demographic, sensors and financial information.

PRIORITY

This application is a continuation of application Ser. No. 17/858,442filed Jul. 6, 2022, which in turn is a continuation of application Ser.No. 16/571,086 filed Sep. 14, 2019 which in turn is acontinuation-in-part (CIP) of co-pending application Ser. No. 16/139,002filed Sep. 22, 2018 both of which are included by reference as if fullyset forth herein.

BACKGROUND

Virtual reality (VR) and its technical cousin augmented reality (A/R)conventionally require a human interface device (HID) to effectuate thefull features of the technology. For example, a user will often wear VRgoggles to see into the virtual reality world. The motion of the user isfed back to the VR system to change the display and provide thesensation of reality. Human interface devices suffer from clumsycontrols and motions detracting from the full effect of the VR display.Often users require input devices with conventional triggers andpush-buttons in each hand to operate even simple VR systems. Theseconventional controllers are throw-backs to the early days of videogaming and are of limited capabilities. As game inputs they might beacceptable, however, when using VR displays to show complex data, simplecontrollers are not sufficient to help a user glean valuable insights.

Humans process visual information rapidly and excel at patternrecognition. However, patterns are generally buried in data, oftenappearing as noise. Having the ability to “play with” the data, bycontinuously varying it, might allow a human user to see patterns hiddenin the noise. Therefore, a way to easily alter complex data is desirablefor large scale data manipulation.

SUMMARY

Disclosed herein is a system and method for visualizing multipledatasets in a virtual 3-dimensional interactive environment. Multipledatasets may be related and virtually cast as 3-dimensional typestructures. User interfaces, such as game controllers or headsets, maybe used to present the dataset from differing perspectives including theappearance of moving through the data. Certain embodiments provide formirror image views that allow for presentation of higher order datasets.Other embodiments provide for animation or motion indicia to show howthe data is changing and the results on the display. The datasets mayrepresent physical areas or virtual areas as well as demographic,sensors and financial information.

By using 3-dimensional display techniques and user interactivity,datasets, correlations, and trends, hitherto unseen, may be visualizedin an environment that allows for a user to easily explore the data byvirtually walking through the dataset. Moreover, interactive controlsallow for easy setting of visualization parameters.

Some embodiments may present actual physical locations such asdatacenters or processing plants, together with real-time sensorinformation, to visualize real-time (or near real-time) processes.

The construction and method of operation of the invention, however,together with additional objectives and advantages thereof will be bestunderstood from the following description of specific embodiments whenread in connection with the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a functional block diagram of a client server system thatmay be employed for some embodiments according to the currentdisclosure.

FIG. 2 illustrates a method according to some embodiments of the presentdisclosure.

FIG. 3 shows an image of an office environment overlaid with receivedsignal strength indicators (RSSI).

FIG. 4 shows an image of an office environment 410 with received signalstrength indicators 412 and event history location 414.

FIG. 5 shows a representation of multiple datasets presented as a 3Dimage overlay.

FIG. 6 shows a representation of multiple datasets presented as overlaid3D images.

FIG. 7 shows data using a person-centric 3-dimensional view as in astadium.

DESCRIPTION

Generality of Invention

This application should be read in the most general possible form. Thisincludes, without limitation, the following:

References to specific techniques include alternative and more generaltechniques, especially when discussing aspects of the invention, or howthe invention might be made or used.

References to “preferred” techniques generally mean that the inventorcontemplates using those techniques, and thinks they are best for theintended application. This does not exclude other techniques for theinvention, and does not mean that those techniques are necessarilyessential or would be preferred in all circumstances.

References to contemplated causes and effects for some implementationsdo not preclude other causes or effects that might occur in otherimplementations.

References to reasons for using particular techniques do not precludeother reasons or techniques, even if completely contrary, wherecircumstances would indicate that the stated reasons or techniques arenot as applicable.

Furthermore, the invention is in no way limited to the specifics of anyparticular embodiments and examples disclosed herein. Many othervariations are possible which remain within the content, scope andspirit of the invention, and these variations would become clear tothose skilled in the art after perusal of this application.

Lexicography

The terms “effect”, “with the effect of” (and similar terms and phrases)generally indicate any consequence, whether assured, probable, or merelypossible, of a stated arrangement, cause, method, or technique, withoutany implication that an effect or a connection between cause and effectare intentional or purposive.

The term “Internet of Things” (or IOT) generally refers to the extensionof Internet connectivity into physical devices and everyday objects.Embedded with electronics, Internet connectivity, and other forms ofhardware (such as sensors), these devices can communicate and interactwith others over the Internet, and they can be remotely monitored andcontrolled. The IOT may include, but is not limited to wireless sensornetworks, control systems, automation (including home and buildingautomation), devices and appliances (such as lighting fixtures,thermostats, home security systems and cameras, and other homeappliances) smartphones and smart speakers.

The term “relatively” (and similar terms and phrases) generallyindicates any relationship in which a comparison is possible, includingwithout limitation “relatively less”, “relatively more”, and the like.In the context of the invention, where a measure or value is indicatedto have a relationship “relatively”, that relationship need not beprecise, need not be well-defined, need not be by comparison with anyparticular or specific other measure or value. For example and withoutlimitation, in cases in which a measure or value is “relativelyincreased” or “relatively more”, that comparison need not be withrespect to any known measure or value, but might be with respect to ameasure or value held by that measurement or value at another place ortime.

The term “substantially” (and similar terms and phrases) generallyindicates any case or circumstance in which a determination, measure,value, or otherwise, is equal, equivalent, nearly equal, nearlyequivalent, or approximately, what the measure or value is recited. Theterms “substantially all” and “substantially none” (and similar termsand phrases) generally indicate any case or circumstance in which allbut a relatively minor amount or number (for “substantially all”) ornone but a relatively minor amount or number (for “substantially none”)have the stated property. The terms “substantial effect” (and similarterms and phrases) generally indicate any case or circumstance in whichan effect might be detected or determined.

The terms “this application”, “this description” (and similar terms andphrases) generally indicate any material shown or suggested by anyportions of this application, individually or collectively, and includeall reasonable conclusions that might be drawn by those skilled in theart when this application is reviewed, even if those conclusions wouldnot have been apparent at the time this application is originally filed.

The term “virtual machine” or “VM” generally refers to a self-containedoperating environment that behaves as if it is a separate computer eventhough it is part of a separate computer or may be virtualized usingresources form multiple computers.

DETAILED DESCRIPTION

Specific examples of components and arrangements are described below tosimplify the present disclosure. These are, of course, merely examplesand are not intended to be limiting. In addition, the present disclosuremay repeat reference numerals and/or letters in the various examples.This repetition is for the purpose of simplicity and clarity and doesnot in itself dictate a relationship between the various embodimentsand/or configurations discussed.

System Elements

Processing System

The methods and techniques described herein may be performed on aprocessor-based device. The processor-based device will generallycomprise a processor attached to one or more memory devices or othertools for persisting data. These memory devices will be operable toprovide machine-readable instructions to the processors and to storedata. Certain embodiments may include data acquired from remote servers.The processor may also be coupled to various input/output (I/O) devicesfor receiving input from a user or another system and for providing anoutput to a user or another system. These I/O devices may include humaninteraction devices such as keyboards, touch screens, displays andterminals as well as remote connected computer systems, modems, radiotransmitters and handheld personal communication devices such ascellular phones, “smart phones”, digital assistants and the like.

The processing system may also include mass storage devices such as diskdrives and flash memory modules as well as connections through I/Odevices to servers or remote processors containing additional storagedevices and peripherals.

Certain embodiments may employ multiple servers and data storage devicesthus allowing for operation in a cloud or for operations drawing frommultiple data sources. The inventor contemplates that the methodsdisclosed herein will also operate over a network such as the Internet,and may be effectuated using combinations of several processing devices,memories and I/O. Moreover, any device or system that operates toeffectuate techniques according to the current disclosure may beconsidered a server for the purposes of this disclosure if the device orsystem operates to communicate all or a portion of the operations toanother device.

The processing system may be a wireless device such as a smart phone,personal digital assistant (PDA), laptop, notebook and tablet computingdevices operating through wireless networks. These wireless devices mayinclude a processor, memory coupled to the processor, displays, keypads,Wi-Fi, Bluetooth, GPS and other I/O functionality. Alternatively, theentire processing system may be self-contained on a single device incertain embodiments.

The methods and techniques described herein may be performed on aprocessor-based device. The processor-based device will generallycomprise a processor attached to one or more memory devices or othertools for persisting data. These memory devices will be operable toprovide machine-readable instructions to the processors and to storedata, including data acquired from remote servers. The processor willalso be coupled to various input/output (I/O) devices for receivinginput from a user or another system and for providing an output to auser or another system. These I/O devices include human interactiondevices such as keyboards, touchscreens, displays, pocket pagers andterminals as well as remote connected computer systems, modems, radiotransmitters and handheld personal communication devices such ascellular phones, “smart phones” and digital assistants.

The processing system may also include mass storage devices such as diskdrives and flash memory modules as well as connections through I/Odevices to servers containing additional storage devices andperipherals. Certain embodiments may employ multiple servers and datastorage devices thus allowing for operation in a cloud or for operationsdrawing from multiple data sources. The inventor contemplates that themethods disclosed herein will operate over a network such as theInternet, and may be effectuated using combinations of severalprocessing devices, memories and I/O.

The processing system may be a wireless device such as a smart phone,personal digital assistant (PDA), laptop, notebook and tablet computingdevices operating through wireless networks. These wireless devices mayinclude a processor, memory coupled to the processor, displays, keypads,Wi-Fi, Bluetooth, GPS and other I/O functionality. The processing systemmay be coupled to a 3D controller for interactivity. This 3D controllertakes human input and provides signals directing the processing systemto alter a display of information. Conventional 3D controllers may beused to virtually move through an image displayed on a screen.

Client Server Processing

FIG. 1 shows a functional block diagram of a client server system 100that may be employed for some embodiments according to the currentdisclosure. In the FIG. 1 a server 110 is coupled to one or moredatabases 112 and to a network 114. The network may include routers,hubs and other equipment to effectuate communications between allassociated devices. A user accesses the server by a computer 116communicably coupled to the network 114. The computer 116 includes asound capture device such as a microphone (not shown). Alternatively,the user may access the server 110 through the network 114 by using asmart device such as a telephone or PDA 118. The smart device 118 mayconnect to the server 110 through an access point 120 coupled to thenetwork 114. The mobile device 118 includes a sound capture device suchas a microphone.

A system as disclosed in FIG. 1 may include one or more user devices 122coupled to the network 114 directly, through the access point 120, ordirectly to remote processing devices. For example, and withoutlimitation, a virtual reality (VR), or game controller may be coupled toa processing device for getting user input. This coupling may bewireless using technologies such as Bluetooth.

Conventionally, client server processing operates by dividing theprocessing between two devices such as a server and a smart device suchas a cell phone or other computing device. The workload is dividedbetween the servers and the clients according to a predeterminedspecification. For example in a “light client” application, the serverdoes most of the data processing and the client does a minimal amount ofprocessing, often merely displaying the result of processing performedon a server.

According to the current disclosure, client-server applications arestructured so that the server provides machine-readable instructions tothe client device and the client device executes those instructions. Theinteraction between the server and client indicates which instructionsare transmitted and executed. In addition, the client may, at times,provide for machine readable instructions to the server, which in turnexecutes them. Several forms of machine readable instructions areconventionally known including applets and are written in a variety oflanguages including Java and JavaScript.

Client-server applications also provide for software as a service (SaaS)applications where the server provides software to the client on an asneeded basis.

In addition to the transmission of instructions, client-serverapplications also include transmission of data between the client andserver. Often this entails data stored on the client to be transmittedto the server for processing. The resulting data is then transmittedback to the client for display or further processing.

One having skill in the art will recognize that client devices may becommunicably coupled to a variety of other devices and systems such thatthe client receives data directly and operates on that data beforetransmitting it to other devices or servers. Thus, data to the clientdevice may come from input data from a user, from a memory on thedevice, from an external memory device coupled to the device, from aradio receiver coupled to the device or from a transducer coupled to thedevice. The radio may be part of a wireless communications system suchas a “Wi-Fi” or Bluetooth receiver. Transducers may be any of a numberof devices or instruments such as thermometers, pedometers, healthmeasuring devices and the like.

A client-server system may rely on “engines” which includeprocessor-readable instructions (or code) to effectuate differentelements of a design. Each engine may be responsible for differingoperations and may reside in whole or in part on a client, server orother device. As disclosed herein a display engine, a data engine, anexecution engine, a user interface (UI) engine and the like may beemployed. These engines may seek and gather information about eventsfrom remote data sources.

This methods and techniques in this disclosure may be effectuated usingconventional programming tools including database tools for collecting,storing and searching through structured data. Moreover, web-basedprogramming techniques may be employed to collect information, displayresults and allocate compensation. Accordingly, software engines may becreated to effectuate these methods and techniques, either in whole orpart, depending on the desired embodiment.

References in the specification to “one embodiment”, “an embodiment”,“an example embodiment”, etc., indicate that the embodiment describedmay include a particular feature, structure or characteristic, but everyembodiment may not necessarily include the particular feature, structureor characteristic. Moreover, such phrases are not necessarily referringto the same embodiment. Further, when a particular feature, structure orcharacteristic is described in connection with an embodiment, it issubmitted that it is within the knowledge of one of ordinary skill inthe art to effect such feature, structure or characteristic inconnection with other embodiments whether or not explicitly described.Parts of the description are presented using terminology commonlyemployed by those of ordinary skill in the art to convey the substanceof their work to others of ordinary skill in the art.

Operation

FIG. 2 illustrates a method according to some embodiments of the presentdisclosure. The method begins at a flow label 200. At a step 210 aprocessing device receive dataset selection from a user. The dataset mayinclude multiple datasets from varying sources.

At a step 212 the processing device receives dataset parameters. Theseare initial parameters to establish how the datasets are visualized.

At a step 214 the datasets are displayed. These displays will bethree-dimension (3D) representations of the datasets according to theparameters received in step 212.

At a step 216, visualization input is received from a user. The inputmay be from a game controller, virtual reality controller, or otherinput device.

At a step 218 the display changes in response to the visualizationinput. In a representative embodiment, the display may change to show aperspective of moving through the 3D environment. This allows forvisualizing the dataset from any point of view as a user travels throughthe data. Moreover, with multiple datasets, the user may visualizepreviously unknown relationships between datasets or probe abnormalitiesin the dataset by visualizing correlations or from differentperspectives.

In a representative embodiment, graphical user interface elements areanchored to a 3D model that represent the state of certain dataanalytics selected by one or more of the user inputs. For example, aslider control might be mapped to the opacity of a data layer on theprocessing system. As the slider is moved in one direction, theprocessor presents that information to the user. In turn, the processingdevice presents the data layer as more opaque. Alternatively, as a slidecontrol is moved in another direction, the data layer becomes moretransparent. These graphical elements may be animated for betterusability, such as fading in text or moving arrows and lines. Moreover,multiple sliders may operate on separate data sets or channels topresent an interactive user experience.

In some embodiments positioning controllers may be employed to providevisualization input from a user. Using positioning tracers a controlleris aware of its relative position and detect when it is within a view onthe mobile application and adjust its own presence or opacity or evenextend virtual controls based on that state. When the user moves thecontroller away, the display might reflect the same data but at adifferent viewpoint—further away.

The data presented may include a variety of data, including, but notlimited to historical, geographic, demographic, economic, environmental,and others. Certain controller operations may control traversal throughthese data sets including traversal though space or time. By way ofexample only, a button may move a virtual user forward in the display ora knob may adjust the point in time for the data being viewed.

A representative operation example may be a financial dataset. In afinancial data view a user interaction could move the data analyticsthrough different times of day or increment/decrement minutes or secondsof a timecode clock. Controls could also set the threshold of datafiltering, such as the minimum price of hotel rooms, or the maximumvalue of a rental property visualized in a 3D display of a city. Trendsin rental values may be displayed over a time frame and a dial or slidermay adjust that time frame. A second data set, for example, propertyprices, may be overlaid and the time frame display controlledseparately. In this fashion, a user may visualize a relationship betweenrental prices and property values that is time dependent. Moreover, auser may cycle through different modes or scenes of data.

Conventional 3D mapping techniques may be employed to effectuate certainembodiments disclosed herein. For example, and without limitation,commercially available tools for 3D visualization may be employed aspart of certain embodiments. Different datasets may employ differentmodeling technologies to optimize data visualization and 3Dinteractivity. Moreover, dataset animation may be simulated by rapidlyplotting datasets in succession.

Alternative Embodiments

Graphical user interface elements may be anchored to a 3D visualizationthat represent the state of the selected data analytics. For example,and without limitation, a slider could be mapped to the opacity of adata layer. As the slider is moved up, the data layer threshold levelmay change and the dataset becomes more opaque; conversely, as it ismoved down, the layer becomes more transparent. These graphical elementsmay animate for better usability, such as fading in text or movingarrows and lines. In the slider layer example, the actual opacity value,a percentage, could be drawn on the slider knob itself as it is beingslid, and then disappear 2 seconds after the user has finished movingthe slider. Thus, the graphical interface elements show the state of thedata as well as the state of the controller's buttons and othercomponents.

Data Capture

When an image is taken using a portable camera such as a smartphone,metadata fields may be attached to it. These fields may include themodel of the camera, the time it was taken, whether the flash was used,the shutter speed, focal length, light value and the locationinformation provided by a GPS receiver. Accordingly, collections ofimages may be used to map out a space such as an office environment. Theoffice space may then be visualized from many perspectives providing theviewer with a 3D replication of the space and allowing the viewer totransverse the space using convention controls such as joysticks, 3Dcontrollers, keyboards and the like. Collected with the images may beother sensor data such as WiFi signal strength, cellular signalstrength, GPS signal information and the like.

Correlating the sensor data with the image data allows for presenting amulti-variable view of a physical space together with the sensors data,thus showing the sense data in relation to the physical space.

FIG. 3 shows an image of an office environment 310 overlaid withreceived signal strength indicators (RSSI) 312. The RSSI is projectedinto the image showing relative signal strength thus showing the signalstrength for the office space in different locations. Animating thevisual allows for a viewer to see the signal strength from differentperspectives, visually identifying areas of good single strength andweek signal strength. In some embodiments color may be used to comparesignal strength from different communication system. This identificationis easy, using the view shown, for a user to understand compared toconventional graphical techniques. Selected RSSI 316 may be highlightedand numerical values 314 presented on the display to provide moreconcrete information about the presentation.

FIG. 4 shows an image of an office environment 410 with received signalstrength indicators 412 and event history location 414. These threelayers of data, displayed as a 3D image, allow greater visualization. Asshow in FIG. 4 the event history location 414 includes information oncellular signal strength and dropped calls. This information may becollected from a user whenever a call is dropped by an application thatallows for a user to detect a dropped call and send the GPS informationto a data store. The indicia representing the dropped calls may bespherical as shown with a size proportional to the amount of callsdropped, the time of a dropped call, or other pertinent information. Insome embodiments the indicia may be a graphical representation of thetype of information being displayed. For example, and withoutlimitation, the indicia may be an image of a cell phone.

FIG. 5 shows a representation of multiple datasets presented as a 3Dimage overlay. In FIG. 5 a visualization of an oil processing facility514 is shown as seen through a virtual or augmented reality headset. Oilprocessing facilities including storage tanks 518 and pipelines 516 areconfigured with sensors 514. These sensors may sense a variety ofproperties such as pressure, temperature, flow rate, pH, and the like.Below the image of the processing facility are a series of graphicalrepresentations 510 and 512. These representations indicate the value ofthe related sensor and may provide real-time or near real-timeinformation. For example, and without limitation, a sensor bank 510 mayindicate temperature for various pipelines, while the display 512 mayindicate flow rate for the same or a different pipeline. The sensor datais presented in a graphical array, however, in some embodiments thegraphical data may be presented mapped-out to conform with theprocessing plan physical layout. In certain embodiments color may beused to show related industries or transactions.

In operation, a user controlling a graphical user interface may “move”through the image on the display including the graphical datapresentation. While shown in “stadium mode” other display modes mayallow a user to move to a particular area of the facility and quicklyvisualize information that historically has been representednumerically. Thus a facility operator may be able to monitor plantoperation visually.

The presentation in FIG. 5 may be animated to show changes over time.For example, and without limitation, hourly (or yearly) sensors valuesmay be displayed while a user moves through the dataspace. Uniquely adisplay as shown in FIG. 5 may show correlations between processingfacilities as movement in 3D space which are hitherto imperceptibleusing conventional charting techniques.

FIG. 6 shows a representation of multiple datasets presented as overlaid3D images. In FIG. 6 geospatial information is presented using multipledatasets to present a 3D image space. In FIG. 6 a first dataset ispresented showing a topography and related parameters 610. In theexample shown, 610 points to buildings with heights corresponding toresidential density.

Projected as a mirror image above the bottom image is a similargeospatial representation except the underlining data parameter 612 isdifferent. Here 612 represents tax income from the properties allowing auser to easily see tax revenue and population density correlations.Further displayed are trajectory lines 614 showing movement of data. Forexample, and without limitation population movement may be displayed. Ifanimated, population trajectory may be display along with changes inpopulation density and tax revenue. A user may enter the 3Dvisualization and interact from a wide range of perspectives.

In certain embodiments utility poles, buildings, power lines, oil andgas lines, telecom cell towers, street lights, and the like may bedisplayed. Overlay data may include county tax records, cell phone radiomeasurements, transportation lines, store sales, and so on. All the datais interactive using a data controller.

Topography similar to those shown in the figures may be used to effect avisualization of a network. This may include real-time traffic to nodes(routers, access points, users, and the like), connections betweennodes, connection quality and similar attributes. Moreover, geospatialinformation may be projected using mirror imaging as show to visualizenetwork in relation to actual space. A user may then move through thedata to locate problem areas or to identify suggestions to new datapathways.

FIG. 7 shows data using a person-centric 3-dimensional view as in astadium 710. In FIG. 7 the “audience” may be divided into categories712, 714, and 716 such as the applicants for loans, or all the customersof an insurance company, or all the customers who have bought productsfrom a store. The people are ‘sitting’ in a ‘data stadium’ 710 and movearound the stadium depending on user-defined filters or adjustments. Inthe example of the finance company, a data controller may adjust theapproval threshold for loans, so many of the people in the stadium wouldmove to the back sections indicating they were no longer approved forthe loan or move to the front when they were approved depending on userinput. This is also to be used for analyzing sales data, for example,and without limitation, bringing all your customers into the stadium andselecting the biggest spenders to “sit” in the front seats and thelowest spenders in the back seats. A user may then filter all sales justby a single product line to visualize the biggest spenders.

A user may move through the 3D space using a controller to repositionthe user with respect to the data. An indicator 718 may show the usertheir direction of travel. Displays, virtually presented on the walls ofthe stadium may be used to present to a user numeric or other relatedinformation to the display.

Software engines may be implemented to provide particular functionalityas described herein. For example, and without limitation, a data enginemay be employed to retrieve data form varying structured data storeswhich then will be transferred to a display engine for displayingaccording to user instructions. An interface engine, which may becoupled to a remote controller, may provide for control to let a userdetermine how to view the data or to transverse through the data asdisplayed.

The above illustration provides many different embodiments orembodiments for implementing different features of the invention.Specific embodiments of components and processes are described to helpclarify the invention. These are, of course, merely embodiments and arenot intended to limit the invention from that described in the claims.

Although the invention is illustrated and described herein as embodiedin one or more specific examples, it is nevertheless not intended to belimited to the details shown, since various modifications and structuralchanges may be made therein without departing from the spirit of theinvention and within the scope and range of equivalents of the claims.Accordingly, it is appropriate that the appended claims be construedbroadly and in a manner consistent with the scope of the invention, asset forth in the following claims.

What is claimed:
 1. A method of data visualization including: receivingat a server a first data source information; receiving at the server asecond data source information; graphically representing the first datasource information as a first three-dimensional structure; graphicallyrepresenting the second data source information as a secondthree-dimensional structure; displaying through a graphical userinterface the first and second three-dimensional structure on anaugmented reality display device at a first perspective; receiving auser input associated with a positioning transducer, said positioningtransducer associated with the display device, and altering the firstperspective to present through the graphical user interface a secondperspective on the display device, wherein the first data source isselected from a group including a physical location, demographicinformation, financial information and sensor data, and the second datasource selected from a group including a geographic location, a radiomeasurement, and a processing facility.
 2. The method of claim 1 whereinthe display device is a smart phone.
 3. The method of claim 1 whereinthe display device is an augmented reality headset.
 4. The method ofclaim 1 wherein the first data set includes a physical structureinformation and the second data set includes sensor informationassociated with the physical structure.
 5. A processor-readable storagedevice encoded with non-transitory processor instructions directing theprocessor to perform a method including: receiving over a network afirst data source information; receiving a second data sourceinformation; graphically representing the first data source informationas a first three-dimensional structure; graphically representing thesecond data source information as a second three-dimensional structure;displaying through a graphical user interface the first and secondthree-dimensional structure on an augmented reality display device at afirst perspective; receiving a user input associated with a positioningtransducer, said positioning transducer associated the display device,and altering the first perspective to present through the graphical userinterface a second perspective on the display device wherein the firstdata source is selected from a group including a physical location,demographic information, financial information and sensor data, and thesecond data source selected from a group including a geographiclocation, a radio measurement, and a processing facility.
 6. The deviceof claim 5 wherein the display device is a smart phone.
 7. The device ofclaim 5 wherein the display device is an augmented reality headset. 8.The device of claim 5 wherein the first three-dimensional structureincludes a stadium.